Bayesian Sparse Spiked Covariance Model with a Continuous Matrix Shrinkage Prior

نویسندگان

چکیده

We propose a Bayesian methodology for estimating spiked covariance matrices with jointly sparse structure in high dimensions. The matrix is reparameterized terms of the latent factor model, where loading equipped novel spike-and-slab LASSO prior, which continuous shrinkage prior modeling matrices. establish rate-optimal posterior contraction respect to spectral norm as well that principal subspace projection loss. also study rate two-to-infinity loss, loss function measuring distance between subspaces able capture entrywise eigenvector perturbations. show tighter than routinely used under certain low-rank and bounded coherence conditions. In addition, point estimator proposed risk bound numerical performance assessed through synthetic examples analysis real-world face data example.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

OPTIMAL SHRINKAGE OF EIGENVALUES IN THE SPIKED COVARIANCE MODEL By

Since the seminal work of Stein (1956) it has been understood that the empirical covariance matrix can be improved by shrinkage of the empirical eigenvalues. In this paper, we consider a proportional-growth asymptotic framework with n observations and pn variables having limit pn/n → γ ∈ (0, 1]. We assume the population covariance matrix Σ follows the popular spiked covariance model, in which s...

متن کامل

Bayesian Masking: Sparse Bayesian Estimation with Weaker Shrinkage Bias

A common strategy for sparse linear regression is to introduce regularization, which eliminates irrelevant features by letting the corresponding weights be zeros. However, regularization often shrinks the estimator for relevant features, which leads to incorrect feature selection. Motivated by the above-mentioned issue, we propose Bayesian masking (BM), a sparse estimation method which imposes ...

متن کامل

Optimal Estimation and Rank Detection for Sparse Spiked Covariance Matrices.

This paper considers a sparse spiked covariancematrix model in the high-dimensional setting and studies the minimax estimation of the covariance matrix and the principal subspace as well as the minimax rank detection. The optimal rate of convergence for estimating the spiked covariance matrix under the spectral norm is established, which requires significantly different techniques from those fo...

متن کامل

Sparse Covariance Matrix Estimation With Eigenvalue Constraints.

We propose a new approach for estimating high-dimensional, positive-definite covariance matrices. Our method extends the generalized thresholding operator by adding an explicit eigenvalue constraint. The estimated covariance matrix simultaneously achieves sparsity and positive definiteness. The estimator is rate optimal in the minimax sense and we develop an efficient iterative soft-thresholdin...

متن کامل

Sparse estimation of a covariance matrix.

We suggest a method for estimating a covariance matrix on the basis of a sample of vectors drawn from a multivariate normal distribution. In particular, we penalize the likelihood with a lasso penalty on the entries of the covariance matrix. This penalty plays two important roles: it reduces the effective number of parameters, which is important even when the dimension of the vectors is smaller...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Bayesian Analysis

سال: 2022

ISSN: ['1936-0975', '1931-6690']

DOI: https://doi.org/10.1214/21-ba1292